In today's digital era, image generation technology is developing at an astonishing pace. Recently, a research team from the National University of Singapore proposed a brand-new framework — OminiControl, aimed at enhancing the flexibility and efficiency of image generation. This framework combines image conditions and fully utilizes the pre-trained Diffusion Transformer (DiT) model, providing unprecedented control capabilities. In simple terms, as long as you provide the source image, OminiControl can utilize it.

Generating high-quality, temporally continuous videos requires a significant amount of computational resources, especially for longer time spans. The latest Diffusion Transformer model (DiTs) has made significant progress in video generation, but its reliance on larger models and more complex attention mechanisms has resulted in slower inference speeds, exacerbating the challenge. To address this issue, researchers at Meta AI have proposed a training-free method called AdaCache to accelerate video DiTs.

Scientists at ShanghaiTech University have developed CLAY, an AI model that can generate detailed 3D objects from text or 2D images, outperforming earlier technologies in quality, diversity, and generation speed. At its core, CLAY includes a multi-resolution variational autoencoder and a diffusion transformer, allowing direct processing of 3D content without conversion. By training on over 500,000 3D models, CLAY can produce objects ranging from everyday items to complex creatures and achieve precise control through additional inputs, generating urban scenes and reconstructing 3D models from sketches.